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AUDIO AND DATA COLLABORATION 
AND COORDINATION SYSTEM 

CROSS REFERENCES TO RELATED APPLICATIONS 
5 This patent application claims priority from and is related to U,S, 

Pfovisionfll Patant Appliration No, 60/124,369. entitled: ENABLED CALL 
CENTER SYSTEM, filed on March 15, 1999. this U.S. Provisional Patent 
Applicaliun incorporated by lefeitinue heidn. 

10 FIELD OF THE INVENTION 

The present invention is related to voice and data applications over 
Internet Protocol (IP) networks, and particularly to systems and methods v/here 
an audio call is. coordinated v^lth a data collaboration session over a network, 
such as the Iritemel. 



BACKGROUND OF THE INVENTION 

The Internet has emerged as an effective way to speed transactiorte and 
-."^ provide RRrvlcR to an ever growing number of users that by earty 2000 Is 
U expected to exceed 47 million. Along with this growrth in users, has come the 
2|. growth of electronic commerce or ''e-commerce*\ online transactions typically 
involving the oalc of goods and services. Thousands of businesses have 
fij entered into e-commerce, realising the lucrative profits that can be gained by 
m reaching this Intftrnet iisRr population with web-based services, advertising. 
¥^ product promotion and sales. 

25 In a typical e-commerce scenario, an audio call is made between a client 

and the agent over the Internet. This audio call typically travels through a 
PSTN^to-IP gateway, and then to the agent's PSTN PBX. The conventional 
prntocoLs assnciaterl with this PSTN technology are limited, and thus, any 
accompanying data transmissions are limited. If even possible.' 



SUMMARY OF THE INVENTION 

I he present Invention improves on the contemporary prt by providing 
systems and methods for coordinating IP auriin calls with data collaboration 
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sessions, including voice and data, over a nelwoik, suuh as ihe Internet. This rs 
accomplished by providing an identifying data field to accompany the audio call 
on Its jnurnfty from caller (sender or client) to intended recipient (receiver u( v 
agent); this ideniifying data field also being ennployed as an identifier of the 

5 t;uufc;!>pundiny cjala collaboration, between the caller, and the intended recipient, 
allowing for the parallel and coordinated Transmission of voice and data over 
Goparatc communication channels. 

Embodiments of the present invention are directed lo call center ay.*^tems 
that allow tor data collaboration sessioHo, such as a web-enabted call center for 

10 audio and data collaboration sessions between a sender, typically a client and a 
receiver, typically a web-enableri :^r}9.nl the system including means for placing 
at least one first cosurfei identifier^ i.e., an Automatic Number Identifier (ANI), in: 
at least one auciio component foi placement in an audio call cf at least one 

£3 

=S sender; and at least one data collaboration cornpontsnL for placement in a data 

"^^^ 

n# call of this at least one sender, 
% The system also includes at least one data collaboration sever configured 

^3 for: receiving first data corresponding to the audio call from the at least one 

:^!^ sender to the at least one receiver, with this first data including at least this first 

f^' . 

- cosurfer identifier, from the at least one sendei and s second cosurfer idfintitier, 
20!" from the at least on© receiver, the first cosurfer identifiei its different than the 
fy second cosurfer identifier; receiving second data including, the first cosurfer 
M identifier, from the did la call from the at least one sender; receiving third data 
2 including the second cosurfer identifier from a data call trom the at least one 

receiver; and processing this first second and Unrd data, to connect a data call 
25 between said at least one sender and at least one receiver, this data call 

between the at least one sender and the at least one receiver in parallel and 

coordinated with the audio can between these same parties. 

Erfibodiments of the present Invention are also directed, to methods for ^ 

conducting audio calls and data collaboration sessions over wide area networks, 
30 for example, the Internet, between a sender, typically a clieiil and a receiver, t 

typically a web-enabled agent. These embodiment© typically comprise providing 

a sender with at least one audio component and at least one data collaboration 



2 



rCT/ILOO/001fi2 

component, providing the sender with a first cosurfcr identifier, i.e., an Automatic 
Nunnber Identifier (ANI). and copying the first cosurfer identifier into at least one 
audio component and at least one data component of the at least one sender. 
The sender then <5Rnc1s first cosurter identitier by the at least pne 

5 audio component, and it joins with a second cosurfer identifier, this s^nond 
cosurfer Identifier being different than the first oosuifei ideiUiner. and coming 
from at least one intended receiver in accordance with an audio call belwetirj the 
at least one sender and the at least one intended receiver. This first cosurfer 
identifier is then sent to at least one seh/er by the data collaboration component 

10 in accordance with a data call. This riat?3 rail trnm the sender is then connected 
with a data call from the a: least one Intended receiver, as a result of the 
receiver having transmitted this second cusuifer ideriLifieT to the ai least one 
server. This results in a data call between the at least one sender and the at 

C3 

least one intended receiver in parallel and coordinated with the audio call 
# between these same parties 

^3 BRIEF DESCRIPT ION OF THE DRAWINGS 

7^ Attention is now directed to the attached drawings, wherein like leference 

^ numeral or characters indicate corresponding or like components. In the 
fto drawrngs: 

pj Fig. 1 is a diagram of an embodiment of the present inyention in use in an 

N exemplary appiication; and 

Fig- 2 is a flow chart of a process useful in implementing an ernUudirnefil 
of the present invention. 

2S 

DETAILED DESCRim K)N HH THE DRAWINGS 
Fiy. 1 bJiuws the present invention in use, from the sirie ot the client 20, 
typically the caller or sender, and the side of the a9ent(s) 22a-22c» typically the 
rectpient or receiver. The client and ogont sides arc connected via a wide area 
30 network (WAN), typinally the Internet 24, 

Fioin the client side, the client 20. has a multimedia HC (e.g.. with a 
Pentium® from Intel .Corporation. Santa Clara, California 95052, ,CPU) with 
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voice ond data capabilities. The multimedia PC 30 employs? an operating 
system such as Windows® NT® (from Microsoft Corporation, Redmond. 
Washington 9805/^) or the like, and is equipped with a suitable modem or other 
hardware for accessing a wirip. <irea networlc (WAN), here the Internet 24. The 
5 PC 30, with monilui 31. is also loaded with snftw;5re that operates. as a browser 
for the internet, exemplary browsers suitable for use hpre Including Microsoft 
Internet Explorer® (Microsoft Corporation, Rediiiond, WA) and NetsrapefSi 
Navigator® and Netscape® Communicator®, the later two from Netscape 
Cnmmiinip.ations Corporation, Mountairl View, California 04043. 

On The agent side, are weh enabled agents 22a-22c. While three agents 
aie shown, ihis vs exemplary only, for any number of agents (one or greater) is 
permissible in accordance with Ihe preseni invention. These ;^gents 22a-22c 
are typically equipped with multimedia PC's 32 with voice and data capabilities, 
and include browsers, in accordance with those detailed above. Each agent 
4 22a-22c uses a regular (POVS) telephone for audio, typically voice. The PC's of 
the agents 22a-22c have a connection to the WAN, here the Internet 24 for data, 
and connect to a Private Brand » Exchange System (PBX) 36 for voice. 

The PBX .system (PDX) 30 connects lo the Internet 24, typically through a 
s gatekeeper 38. For example, one gatekeeper 38 may be a VocalTec® 
fib Gatekeeper®, from VocalTec Communications, Ltd.. Herzlia 46733, Israel, 
although a gatekeeper is not nftcessary. 

Within the PBX 36 is an automatic call rilsTribution unit (ACD) 40, that 
;f functions as a switch, to route voice calls tu Itie selected agem ZZb-22c, typinally 
the first sv/ailable agent, For example, one AGO suitable for use with this system 
?s IS 3 DEFINITY G3 ACD from Lucent Technologies. Murray I lili, New Jersey. 

The PBX connects to a Telephony Serv/er (T-server) 42, that is configured 
to converl PBX telephony data into Internet Protocol (IP) data. For example, a 
suitable T-son/cr for use with this system is a PacketStar™ Injernet Telephony 
Serv/er from Lucent Technologies, Murray Hill, New Jersey* 
30 The T-sen/er 42 connects to a Data Collaboration (DC) Server 44 that in 

tuni, connects lo the internet 24. The UC server 44 typically includes a 
co-resident Computer Telephone Iniegration (CTI) driver 45. The DC server 
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provides Ihe inlet (aue between an inc;oming client (customer) call, telephony 
gateway terminals and call center equipnnent, such as the ACD/swilch, and the 
Internot 24. For example, the DC server and CTI driver are available as a 
VocalTec® Surf & Call^ Server (available from VocaiTcc Communications, 
s 1 td., Herzelia, Israel). 

Servers 1 and 2, indlcaTP.ri as 50, 62. are connected to the Internet 2A. 
These servers 50, 52 aie exemplary of the endless number of sfirvRrs that are 
connected to the Internet. 

One server, typically the DC Server 44, but other servers such as Servei 
10 • 1 (50), for example, hosts a web-sit© that includes downloadable software- This 
software is configurftri to allow for the placement of contemporaneous audio, 
typically In the form of voice, and data calls between client and agent. 

One exemplaiy ^^o^tware pacKage suitable for the audio call nnmponent, 
^ that makes the audio (voice) call, is Suif & Call Center^" (VocalTec 
jil Communications, Ltd,, Herzlia, Israel), hoving the Surf & Call® software from 
Vocal I ec C.:ommunications, Ltd.. Herzlia, Israel, an embedded plug-in enabling 
web-to-phone call center applications from a standard web page. The data call 
uan be made via a data collaboration (DC) component, typically in JavaScnpt or 
code within an applet, that Is typically also on the DC Seiver 44. For example, 
% one coftware pockagc v/ith e suitable DC component is a VocalTec® Cusuifei 
DC Component (from VocalTec Communications, Ltd., Herdia, Israel), that Is 
f typically pan of the Surf & Call Center^M, detailed above. 

The DC Servei 44 or other server 50 also includes additional -lavaScrtpt 

IS!-} 

code for processing the Automatic Number IdenUficalion (ANl) as detailed 
25 below. Once downloaded into the client's PC, the audio call compoueul 60 and 

the DC Component 61 can, for example, appear on the monitor 31 (JavaScript 

or code applet not shown) 

The audio call component, data call component, JavaScript code, and/or 

porlionc thereof can be on different servers and are not restricted to any 
30 particular server. Also, these components and portions thereof can be on 

storage media such as disks. CD*s etc, as well as some portions on scn/ors and 

some portions on storage media. 
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Another server, for example, Serv£=ir y 52 may serve as an ANI 
generator, di&cussecl below. 

An implemontation of the process of the piesient invention will now be 
described. The user or ciient 20, his browser open, lias downloaded software. 

5 for Thfi planfiment ot contemporaneous voice and data calls -along respective 
voice and data channpls between the client 20 and the respective agent 
22a-22u. Here, for example, the client 20 has employod the Surf & Call 
Center^*^, having the Surf & Call® software, an embedded plug-in, as detailed 
above» for facilitating an audio IP call between the client 20 and the agent 

in 22a-22c. While the Surf & Call® software is shown, other :suitable software fnr 
this application can be that with the ability to mel^e an Internet Protocol (IP) 
telephony call from a web browser and the ability to transmit an ANI along with 
the audio call, the audio call in accordance with standard contemporary 

J telephony. 

^ The client 20 has also obtained, typically by downloading, a Cosurter 

% n;^ta Collaboration (DC) component, such as the VocaUeo® Cosurfer DC 

Component™ (VocalTec Cnmmunications, Ltd., Herzlia, Israel), for facilitating 
f: the data call lo the DC server 44 » along with JavaScript code. The JavaScript 
g code functions in distributing the ANi to both the audio nail component 60, here, 
il the Surf & Call® software, and the data collaboratton component 61 , both 
pj components 60» 61 appearing as portions on the client's monitor 31 . 

Turning al.«io to hig. 2» the prooesG continues, as an Automatic Number 
rj Identifies Lion (ANI) is generated in the browser of the client 20, such as in either 

JavaScript or In a Java applet. An ANI can also be requested from a server with 
as code to reserve ANI's, request sequential numbers* generate random numbers, 

generate numbers from a database, etc. The resultant ANI need only be such 

that it is unique to each client, whereby any two clients do not have the same 

ANI at Uie same time. 

This ANI serves as a unique Idenfifiar of the clients particular coordinated 
30 audio and data calls with the selected web-enabled agent in real time. The ANI 

is a cosurfer identification for the client 20, identifying the client 20 to* the 

telephony system (i-e., in the audio call) and the DC scn/er 44 (i.e., in the data 
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call), and typically passes through the respective audio and data calls made by 

the client 20 as a data field, 

Thfci AN! is a fifteen diflit number that conforms to £.154, the specification 

for telephone numbers, as described in "Numberiny Plari For The ISDN Era, 
B Recommendation E.154", CCITT (1991), ■ this document incorporaLed . by 

reference herein. A number in accordance with this E.164 standard has its fiiist 

three digits corresponding to a country code, with the remaining twelve digits a 

National Significant Number. 

Heie, Ihe first tl'iiee digits of the KnI are formed, as they ^re. ?issigned by 
10 the same mechanism that generates the ANI, or by anulher mechanism, such as 

using o constant volue. Those first three digits mimic a country coUt; ai> per the 

E.164 standard,^ but are not assigned to any country, as per the E.I 84 standard, 
■ 

at step 102. Ihe remaining tweiv/e digits are created randomly, via a random 
y3 number generating program on the PC :w ot the client or via the internet 2A^ 
^ from a server, such as Sen/er 2 (52), or as othenwise detailed ahnve. at step 

104. These numbers are then brought together, at sle^j 106, resulting in the 
f ANI. 

2 At step 108. the ANI is stored in the client's disk (in the client PC 30), 

typically in a browser cooKie, This ANI is stored by means such as JavaScript 
|| cude. By sluiing Uie ANI in a cookie, the next time that an ANI is needed by the 
W client 20, it will come from this cookie, and not fjum random .number generation 
methods, such as those detailed above, 

U 

U IhR .lavaScript code then sets the ANI, by copying it and setting one 

copy in the audio call component, here the Surf K Call® component (segment 60 

25 in the screen shot of Ihta client's monitor 31), at step lio; and setting another 
copy of the ANI in the data call conipoiitinl, here the Cosurfer Data 
Collaboration Component Applet (segment 61 in the screen shot of the clients 
monitor :i1). at step 111. These two stops, steps 110 and. 111, should be 
ptji fanned contemporaneously anrt/or in parallel, and preferably, simultaneously. 

so Additionally, the ANI is placed into the data field allotted by telephony 
specifications to the phone number of the calling party, here Ihe client 20, at 
step 110a. 
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With the ANI in the audio call and data call components, Che audio call is 
initiated, at step 114. Here, Ihe audio call initiation i$ in accordance with the 
standard H.323 protocol, this protocol being that of the Surf & Call® software. 
Specifically, audio call initiation with the audio component fronn the Surf & Call® 
5 software is via a Surf & Call® burton nr iron ii'^ (hig. 1), that appears on screen 
31 (for example as a pop-up) and is "clicked" (prRR5;ed) by a mouse or the like. 
Moreover, when the Surf & Call Center™ is employed TO provicJe. rhe audio 
component 60 and the DC component 61 , the "dickinq" or presiiing of Ihe Surf A 
Call® button or icon 62 starts the DC cimponcnt 61 attempting to connect lo the 
10 DC server 44, thus tniriahng the data call from the client 20, at stop 115. 

With respecT to the audio nail, the ANI travels with the audio call through 
the gatekeeper^(GK) 38 so as 10 connect with the AGO 41) in the PBX 36. at step 
116. If there is not a connection with the ACD 40 in ihe PBX 36, at step 116a, 
^3 the process stops, until reinitiated by the client 20. At optional step 116a\ the 
# anrijn call ts again initiated (step 114 performed ogain). Once there is a 
^ connection with the ACU 40 in the PBX 36, at step 116b, this is a Start Call 
yi event, as the ANI iis passed with Ihe call 10 this ACD 4l) (with data corresponding 
^ thereto ultimately passed to the DC server 44, as detailed below), at step 118, 
^ With respect to the data call, the Cosurfer Data Collaboration (DC) 

hk> component, typically the applet, connects the client PC 30 to the DC Server 44 
fi l at Step 11 5a, typically over a TCP/IP socket link. This connection results in the 
client 20 data uall to the DC servRr 44, where the ANI and the cosurfing data, 
2 including, for example, shaied Uniform Resource Locaiors (lJKl.s) are passed to 
the DC sender 44, Alternately, the DC component can include software 
2S programmed such that the start call event also initiates (staiLs) the above 
described data call. 

These two call inlliation .steps, steps 114 and 11S should be performed 
close in time and in paiallel, and preferably, simultanftnusly. This* can be done 
by programming the audio and DC Components la initiate the respective audio 
:^o and data calls at the times desired. 

Once the audio call with the ANI is in the ACD 40, it io routed to the web 
enabled agent, here one of agents 22a-22n. I he ANI and the telephone number 
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(extension number) of the agenl 22a-22(; also exits the PHX 36 and travels to 
the T-sen/er 42. where it is converted to a formal recoQntzablfi hy a CTI Driver 
45. such thai the ani and the agent telephone (extension) number can be sent 
10 [Ua CTI driver 45 in the UC sen/er 44. The telephone (ejrtension) number nt 
5 -the .agent. 22a-22c, lypically servas as -the agent's cosurfcr Identification, fur both 
the ogcnt audio call and the agent data call, as detailed below. 

This CTI driver 45 is programmed to identify thei ANI as an identifier for a 
data collaboration session, ond not a countiy uode, as per the b.l64 Standard 
(above). The C 1 1 driver then passes the ANI to the DC server 44, along with the 
10 nunibei of liie pany. here the specific agent 22a -220. to whom the audio (voice) 
call was connected. 

On the^ agent side, d Cosurfer Data Collaboration (DC) Component, 
typically identical to that of the client 20 has been downloaded to the browser of 
each agent 22a-22c. Also, the specific agent 22a-22c has transmitted his 
fli5 oosurfer identification, here his telephone (e>dcnsion) number, that corresponds 
^ to and sei-ves as an Identtfier for his computer, into the DC server 44, by either 
y| sending it, vie a data call, manually or via a conventional program over the 
4? Internet 2^1. As a result of sending his cosurfer identification, each agent is 
: typically connected to the DC Server 44, via his cosurfer DC component. 
M20 The DC Server 44 has now received data corresponding lo the ANI and 

agent telephone (extension) number of the now connected audio call between 
client 20 end specific ageiit 22a-22c. The DC server 44 has also received the 
At^l from the client's data call, at step llSa, and has also received the agent's 
cosurfer Jdantification. here the agent's telephone extension number, as detailed 
26 above. The ANi data (the ANI'e) of the client audio cuinponeni and client data 
colloboartin cumponeni are matched, by convnetinal comparison piograms. as 
arc the teelphone (extension) numhftr data (telephone numbers) of tlie agent 
22a-22c audio component and agent data collaboration component 
Convnetinnai matching software then matches the ANI data (ANI) associated 
30 wiltj the client Data colloboartion component to the telephone (extension) 
number data (teleplwne number) associated with the agent data colloboralion 
component. With this match complete, the DC server 44, executes a standand 



¥=1 



9 



31.PtUG.200i 0:12 ^OCALTEC COMM. LTD 

WO0Q/S60€0 PCnyXLOO/00162 

program to connect the client 20 and the specific agent :^2a-22c therein, 
allowing for the passage of data between the client 20 and the specific agent 
22a-22c, lesuiting in the nompletion of the data call from the client to the 
specific web enabled agent 2??i-'>^2c, via the Internet 24. 
5 This results in a data ccdatsorailon session on parallel voice and data 

channels, where the client 20 and Llie web en?5hled agent (one of 22e-22c) are 
in voice communication via the audio call (over the audio nhannel), as well as 
browsers coordinated to view same web site and/or page, via thp. data call (over 
the data channel). This data collaboration cession allows for tlie sharing of web 
. 10 , documents in conjunclion with a vntce conversation in real time- Addilionally, 
the data collaboration session can Inciurle guided web browsing, where an 
agent can guide a customer to a web page, typically by transmitting a Uniform 
Resource Locator (URL), joint form handling, where call center agents assist a 
customer in filling out a form in reol time, text chat, wheie agents and nhents can 
exchanfle real time text messages and other similar functions. 

Alternately, l(ie present invenhr^n may employ an event handler, detailed 
in commonly assigned PCT Patent Application entitled: AN IMPROVED AUDIO 
AND DATA C0LA80RATI0N AND COORDINATION SYSTEM, filed on even 
date herewith and Incorporated by reference herein, as part of the system, as 
shown and described in Hg. 1 above. The event handler ia typically In the DC: 
server 44. It functions to maintain the cosurfer connection between client 20 
and agent 22a-22c in the absence of a browser connection on the client or agent 
side. 

The methods and apparatus disclosed herein have been described with 
25 exemplary reference to specific hardware and/or softwate. The methods and 
apparatus have been describfiri in a manner sufficient to enable persons of 
ordinary skill in the ail to readily adapt other commerciolly available hardwaie 
^ and software as may be needed to reduce any ot the enr\bodimente of the 
present Invention to practice without undue experimentation and using 
30 conventional techniques. 

While preferred embodiments ot the present invention have been 
described, so as to enable one of skill in the art tn practice the present Invention, 
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the preceding desuipUon is iniended tn he exemplary only. It should not be 
used to limit the scope of ihe invention, which should be determined by 
reference to the following claims. 
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What is claimed is: 

1 . A web enabled gqII center system cumprising: 

means for placing at least one first cosurfei identifier in at least one 
audio component fnr placement in an audio call of at least one senrier 
5 and at (east une data coinhoration component for placement \u a data 

call of said at least one sender; 

at least one data collaburation server sevFir configured for; 

receiving first data oorrespunding 10 said atidio call from sold 
at least one sender to said at least one leceiver. said hrst data 
10 including at least said first cosurfcr identifier and a second cosurter 

ideiiliner from said at least one receiver, oaid first cosurfei identifier 
bilng differem than said second cosurfer identifier; 
P receiving second data including said first cosurfer identifier, 

% from said data call from said at least one sender: 

p receiving third data including said second cosurfer identifier 

fro*"^' <^ data call from said at least one receiver; and 

& 

M processing said first, second and tinird data, to connect a data 

^ ■ call from said at least one sender to at least one receiver, said data 

J,!, csill between said at least one sender and said at least one 

P receiver in parallel with said audio call between said at least one 

sender and said at least one receiver. 

a 

2. The system of claim 1, wherein said addressing server Is additionelly 
configured tor: 

25 completing a data call between said addressing server and said receiver 

once said Hist cosurfer identifier and said second cosufer identifier have been 
matched. 

3. The system of claim 1. additionally comprising means for generating an 
30 Automatic Number Identification (ANI). said ANI definirig said firat cosuifer 

•idenBfier. 



12 



31.ftUG.2001 0:13 VOCALTEC COMM. LTD 




WO 00/56050 PCT/ILOO/00W2 

4. The svslem of claim 3. wherein said me=ian.s for generating an ANI includes 
first means for geneiating a firsi 3'dlgit number mfmicking a country code and 
second means for generating a second 12-diyil landom number. 



A 5. A method for conducting o data collaboration session over a wide area 

network comprl.<:;infj: 

piuviding a sender with at laaRt one audio component and at least one 

data collaboration component. 

providing a first cosurfer idenlififcii lu at least one sender; 
10 copying said first cosurfer identifier into said at least one audio 

component and said at least one data component; 

sending said first cosurfer identifier by said at least one audio compoi^enl. 

and a second cosurfer identifier from an intended receiver, said occond cosurfer 

identifier different than said first cosurfer Identifier, in ar-nordance with an audio 
^il call between said at least one sender to at least ont; irtlended receiver; 
j;? sending said first cosurfer identifier to said at least une server by said 

^ data collaboration component in accordance with a data call; 
2? connecting said dat» call from said at least one sender to a data call from 

n said at least one intended receiver^ after said intended receiver has transmitted 
fab said second cosurfer identifier to said at least one server, such that at least a 
ly portion of said data call between said sender and said <A least one Intended 
^ receiver rs in parallel with said audio call between said at least one sender and 
5 said at least one intended receiver. 

25 6. The method of claim 5, additiunally conr^prislng: 

providing at least one ser/er, said at least une server including a Data 
coHaboraiion server. 

7. The method of claim 5. wherein salcl step ot providing a first cosurfer 
30 identifier to at leost one sender Includes generating an Automatic Number 
ldentmer(ANi). 
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8. The method of claim 7, wherein said step of generating said ANl includes 
generating a 15 digit number. 

9. The method of clahn 5. wherein said step of generating a 15 digit number 
s includes: 

generating a first three digit number mimicking a country code in 
accordance with thft E,164 telephony standard; and 

generaUng a ss;RCond twelve digit numbtji, to follow said three digit 
number. 

10 
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